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In January 2004, NASA established a new, long-term 
exploration program to fulfill the President's “Vision for 
U.S. Space Exploration”. The primary goal of this 
program is to establish a sustained human presence in 
space, beginning with robotic missions to the Moon in 
2008, followed by extended human expeditions to the 
Moon as early as 2015. In addition, the program places 
significant emphasis on the development of joint human- 
robot systems: 

NASA will send human and robotic explorers as 
partners, leveraging the capabilities of each where most 
useful. Robotic explorers will visit new worlds first, to 
obtain scientific data, assess risks to our astronauts, 
demonstrate breakthrough technologies... Human 
explorers will follow to conduct in-depth research, 
direct and upgrade advanced robotic explorers, etc. 

- NASA Vision for Space Exploration 

A key difference from previous exploration efforts is that 
future space exploration activities must be sustainable 
over the long-term. Experience with the space station has 
shown that cost pressures will keep astronaut teams small. 
Consequently, care must be taken to extend the 
effectiveness of these astronauts well beyond their 
individual human capacity. Thus, in order to reduce 
human workload, costs, and fatigue-driven error and risk, 
intelligent robots will have to be an integral part of 
mission design. 

Space robotics 

Although robots have previously been used for scientific 
purposes (e.g., geology) in space, robots will now also be 
called upon to perform non-scientific work. In particular, 
robots will be used for a wide range of tasks (under 
human control and autonomously) ranging from on-orbit 
assembly and maintenance of spacecraft to construction 
and maintenance of surface habitats to prospecting and 
processing of raw materials. The intricate nature of these 
tasks may require teams of robots capable of monitoring 
their own progress with a high level of autonomy. 

Considerable research has already focused on developing 
human and robot systems for planetary surfaces. Scant 
attention, however, has been paid to creatingyozn/ human- 
robot teams. Such teams, however, are attractive for 
numerous applications. Robots could support long- 
duration manned excursions by scouting, by surveying, 
and by carrying equipment. Robots could assist in site 
preparation, sample collection and transport. Finally, 
robots could be used for field labor, inspection and 
maintenance, and servicing of equipment and structures. 


Construction 



Artist conception of humans and robots jointly 
building a space telescope. (NASA) 


Construction, both in-space (on-orbit) and on planetary 
surfaces, is a fundamental exploration task. Because 
structures are expected to be large and heavy, robots will 
be needed for a range of construction tasks including 
material transport, equipment positioning, and assembly. 
For example, planetary outpost construction will involve 
the transport, positioning and assembly of habitat modules 
that have been deposited (landed) in a scattered manner 
around the construction site. 


Infrastructure support 



Artist conception of human-robot lunar operations 
(NASA) 


Long-duration exploration will require significant robot 
support to maintain and service infrastructure. Robots 
could be used to search for, identify, and repair loose 
fixtures on interior structures (e.g., inside crewed 
spacecraft) and outdoor structures (solar panels, 
communication arrays, etc). A key challenge will be 
enabling the robot to perform these tasks as autonomously 
as possible, requesting human assistance and expertise 
only when necessary. 



Contingency life support 



Artist conception of robot assisted medical transport 


(NASA) 

Lunar pioneers will encounter hazards and crises 
requiring new emergency procedures. Given that crew 
sizes will be small, responding to medical emergencies 
will require robotic support. For example, robots could 
provide contingency life support or medical transport. 


Science exploration 



Artist conception of joint human-robot exploration 
(NASA) 


Robots have long been identified as potentially useful 
assistants for science exploration. Since the 1990's, 
numerous researchers have studied how mobile robots can 
support the field activities of biologists and geologists. 
Robots can perform a wide variety of functions: scout, 
equipment transport, caretaker (monitor the scientist’s 
health during EVA), and co-worker (deploy sensor, 
survey region, etc.). 


In-situ resource utilization 



Firestarter concept for robotic regolith collection 
(courtesy iRobot Corp) 


Launching and deploying all the materials (consumables) 
that will be needed for a permanent outpost is so cost- 
prohibitive, that in-situ resources will have to be used. In 
order for In-Situ Resource Utilization (ISRU) to be cost 
effective, however, humans will need to work with robots 
to mine, collect, transport, and process materials such as 
regolith. 

HRI challenges 

The interactions between humans and robots during 
extended space missions will be unlike anything that 
NASA has designed and implemented to date. The 
operation of robot teams will at times be directed from 
ground control. For example, a lunar rover team may be 
assigned tactical assignments (e.g. “inspect solar array 
alpha”). Surface astronauts will also communicate with 
in-situ robots using voice-based commands, gestures and 
wireless digital communication. Rovers, in turn, will 
communicate with one-another for team-based 

collaboration and must also develop sufficient self- 
diagnostic introspection to request human help when 
appropriate. 

Making human-robot interaction (HRI) effective, 

efficient, and natural is crucial to the success of sustained 
space exploration. In particular, we contend that humans 
and robots must be able to: (1) communicate clearly about 
their goals, abilities, plans, and achievements; (2) 
collaborate to solve problems, especially when situations 
exceed autonomous capabilities; and (3) interact via 
multiple modalities (dialogue, gestures, etc), both locally 
and remotely. To achieve these goals, a number of HRI 
challenges must be addressed. 

Multiple spatial ranges 

Exploration will require human-robot collaboration across 
multiple spatial ranges, from shoulder-to-shoulder (e.g., 
human and robot in a shared space) to line-of-sight 
interaction (human in habitat, robot outside) to over-the- 
horizon (human in habitat, robot far away) to 
interplanetary (human at ground control, robot on 
planetary surface). Although a great many telerobotic 
systems have been developed during the past 50 years, 





daunting task, and overcoming these divides may prove to 
be the biggest challenge of all. 


\ 


none currently support multiple spatial ranges, i.e., all 
existing systems are optimized for application-specific 
spatial ranges. The challenge for space exploration, 
therefore, is to develop HRI techniques that support 
human-robot collaboration over a wide range of distances. 

Interaction architecture 

Interaction architectures are structured software 
frameworks that support human-computer interaction. 
These architectures typically provide a set of core services 
(messaging, event and data distribution, etc.), support a 
variety of interfaces and displays, and facilitate human- 
centered interaction. Significant research effort has 
focused on interaction architectures during the past 
several years, particularly for ubiquitous and context- 
aware applications, but few are appropriate for robotics. 
Moreover, none support the range of interaction scenarios 
and data requirements we believe will be necessary for 
long-term exploration. 

Peer-to-peer dialogue 

Human-robot dialogue is an emerging sub-domain of HRI 
research. At present, most HRI systems rely on explicit 
dialogue (i.e. task commands), which is directed from a 
human to one (or more) robot(s). A few systems, such as 
the Naval Research Lab's multi-modal robot dialogue 
system, use multiple interaction modes (gesturing, natural 
language, etc.) to improve usability and disambiguation. 
In all these systems, however, the dialogue model is 
essential the same: the human “speaks” and the robot 
“listens”. What we need for exploration is dialogue that 
works both ways. We need to build systems that enable 
robots to ask questions of the human (so that they can 
obtain assistance with cognition and perception) and to 
develop techniques so that robots will be able to make use 
of “implicit” language and gesturing. 

Constrained interfaces 

Human-robot teams will require appropriate user 
interfaces in order to effectively perform exploration 
“field labor”. Because humans will need to interact with 
robots in a variety of ways (different levels of autonomy, 
different spatial arrangements, etc.), a wide range of 
interfaces will be needed, both inside habitats and in 
EVA. Moreover, to improve usability and interaction 
effectiveness, a significant challenge is to develop 
constrained, standardized user interfaces. Standardized 
methods will reduce training time and will increase 
reusability by allowing modular improvements. 

Conclusion 

The goal of effective, diverse collaboration between 
teams of humans and robots demands broad collaboration 
between members of disparate fields, including human 
factors researchers, human-computer interaction experts, 
roboticists and artificial intelligence researchers. Enabling 
fruitful collaboration across the philosophical and 
scientific divides of disparate fields of inquiry can be a 


